A Regularization-Based Big Data Framework for Winter Precipitation Forecasting on Streaming Data
نویسندگان
چکیده
In the current paper, we propose a machine learning forecasting model for accurate prediction of qualitative weather information on winter precipitation types, utilized in Apache Spark Streaming distributed framework. The proposed receives storage and processes data real-time, order to extract useful knowledge from different sensors related data. following, numerical aims at type given three classes namely rain, freezing snow as recorded Automated Surface Observing System (ASOS) network. For depicting effectiveness our schema, regularization technique feature selection so avoid overfitting is implemented. Several classification models covering categorization methods Bayesian, decision trees, meta/ensemble methods, have been investigated real dataset. experimental analysis illustrates that utilization could offer significant boost performance.
منابع مشابه
Fuzzy Data Envelopment Analysis for Classification of Streaming Data
The classification of fuzzy uncertain data is considered one of the most challenging issues in data analysis. In spite of the significance of fuzzy data in mathematical programming, the development of the analytical methods of fuzzy data is slow. Therefore, the current study proposes a new fuzzy data classification method based on fuzzy data envelopment analysis (DEA) which can handle strea...
متن کاملFuzzy Data Envelopment Analysis for Classification of Streaming Data
The classification of fuzzy uncertain data is considered one of the most challenging issues in data analysis. In spite of the significance of fuzzy data in mathematical programming, the development of the analytical methods of fuzzy data is slow. Therefore, the current study proposes a new fuzzy data classification method based on fuzzy data envelopment analysis (DEA) which can handle strea...
متن کاملA Partially Combined Framework: Forecasting Container Throughput with Big Data
This study proposes a partially-combined forecasting framework for container throughput based on big data composed of structured historical data and unstructured data. Under the proposed framework, the structured data (the original time series) is firstly decomposed into linear and nonlinear components. Seasonal auto-regression integrated moving average model (SARIMA) is adopted to capture and ...
متن کاملQunatitative Precipitation Forecasting Using Cloud-based Techniques on Avhrr Data
Tri-yearly recurrence of flooding in Malaysia has made floods the most important significant natural disaster in the country in terms of cost and damage to property. Many hydrological and hydraulic flood models have been implemented but are yet to meet the requirement of a near real-time flood forecasting. This study envisage the “Nowcasting System” through the operational coupling of quantitat...
متن کاملA Fuzzy TOPSIS Approach for Big Data Analytics Platform Selection
Big data sizes are constantly increasing. Big data analytics is where advanced analytic techniques are applied on big data sets. Analytics based on large data samples reveals and leverages business change. The popularity of big data analytics platforms, which are often available as open-source, has not remained unnoticed by big companies. Google uses MapReduce for PageRank and inverted indexes....
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics
سال: 2021
ISSN: ['2079-9292']
DOI: https://doi.org/10.3390/electronics10161872